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AN ANALYSIS OF THE PERFORMANCE OF FIRST-SEMESTER COLLEGE 
STUDENTS ON A MULTIPLE-CHOICE TEST OF PROFICIENCY IN GERMAN 
GRAMMAR REVEALED A CURIOUS PATTERN. LOW SCORING STUDENTS 
TRIED TO. ESTABLISH A CORRELATION BETWEEN THE DETERMINER AND 
THE WORD PRECEDING IT, APPARENTLY BY MATCHING SIMILAR CR 
PARALLEL FINAL VOWELS OR CONSONANTS WITH INFLECTED ENDINGS 
(FOR EXAMPLE, "NEBEN DEN- OR "UEBER EINER-) . TESTS SHOULD BE 
IMPROVED, CONSEQUENTLY, BY REVISING ALL ITEMS IN WHICH POOR 
STUDENT MIGHT COME UPON THE CORRECT RESPONSE BY FOLLOWING 
SUCH AN ERRONEOUS SYSTEM. THIS ARTICLE IS A REPRINT FROM “THE 
GERMAN QUARTERLY" VOLUME 40, NUMBER 1, JANUARY 1967. (AS) 
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IMPROVING MULTIPLE-CHOICE GRAMMAR TESTS 

IN GERMAN 

Rebecca M. Valette 

One of the objections most frequently levelled against multiple- 
choice tests, be they in German or any other subject, is that poorer 
students often guess the right answers and occasionally obtain higher 
scores than merited. This danger can be considerably reduced by 
eliminating items in which students frequently tend to guess the right 
answer for the wrong reasons. It was precisely with tliis intention in 
mind that the following study was carried out: On what grounds does 
the poorer student tend to select the response to an item he does not 
know? 

The experiment 

Five classes of first-year first-semester college German (82 stu- 
dents) were simultaneously given a comprehensive objective-type final 
exaimnation. The examination included sections on listening discrim- 
ination, listening comprehension, reading, writing and dictation. The 
written parts ^ere giaded objectively according to a prearranged point 
system and each student's total score w'as reduced to numerical terms. 
Overall performance determined the selection of the upper and 
lower 27% of the papers; item analyses were carried out on the 
machine-scored parts of the test.* 

The grammar items 

Multiple-choice questions evaluating passive knowledge of mor- 
phology and syntax were presented as reading items. From the ped- 
agogical point of view, this type of discrete item is not recommended as 
a homework or daily quiz device: for the audio-lingual classroom, 
pattern-type exercises are more effective in bringing the students to 
think in the foreign language. On a comprehensive test, however, 
the multiple-choice items allow^ the teacher to sample a large number 

» I should like to express my appreciation for their assistance to Dr. 
Clifford Stewart and to Mrs. Harriet Seligssohn, sUtistician for tho 
Office of Evaluation Services, University of South Florida. 
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of aspect of structure in a relatively short period of time. Moreover tlie 
scoring is rapid and objective. 

Once the student has mastered the indirect-direct object pattern 
in German and acquired the linguistic habit of saying: “Ich gebe dem 
Mann das Buch,” he should experience no difficulty with a test item 



As the student reads the sentence, he automatically furnishes the 
correct form. In a sense such an item parallels the student’s thought 
process in the foreign language: he first considers who is to receive the 
l^k, that is, the man, and employs the proper article and form of 
the noun as a matter of habit.’ 

In this section of the final examination, the grammar items were 
^ presented with four options. The response patterns of the upper 
27%, as could be predicted, generally showed 17 to 21 correct re- 
sponses per item; 22 papers were included in this group. The re- 
sponse patterns of the lower 27% w'ere given special attention. 

Performance of the lower group 

The grammar section proved to be the most difficult part of the 
t«t. Generally the response of the lower group (22 papers) spread 
themselves evenly over the possible options; this pattern would indicate 
that the ^rer students were guessing rather aimlessly and that on a 
senes of four-option items only one-fourth of the sample would tend 
to select the conect answer. 



such as: 



Ich gebe — das Buch. 



A. der Mann 

B. des Mannes 

C. dem Mann 

D. den Mann 



® For pedafogical reasons the lonirer item form 
more common short forms: 



Ich gebe (der, des, den, dem) Mann das Buch 
oMAgebe-Mnnn das Buch. A. der B. des C, dem D. den 



uie proper association of noun and determiner. 
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Let m constder *01110 typical examples:’ 

1. Dai Auto gehdrt— . A. ich (6) 



2. Wir fahren alle auf — . 


8. mein (6) 

C. mir (7) 

D. mich (3) 

A. das Land (7) 

B. des Landes (3) 

C. dem Lande (8) 

D. den Landem (4) 


3. Die Semne schien durch— . 


A. der Wald (6) 

B. des Watdes (7) 

C. dem Wald (3) 

D. dmi Wald (4) 


4. Richard geht heute zu— . 


A. cin Ant (6) 

B. eines Arztes (6) 

C. einem Arzt (5) 

D. einen Arzt (5) 



Other items, however, showed a distinct deviatimi from the 
expected random distribution of answers. Consider the following: 



5. Der Schuler steht zwischen- 


A. die Fenster (1) 

B. des Fensters (7) 

C. das Fenster (3) 

D. don Fenstem (10) 


6. Richard bat sie um — . 


A. der Zucker (3) 

B. des Zucken (2) 

C. dem Zucker (10) 

D. den Zucker (6) 


7 . Vor — steht ein Tisch. 


A. der Stuhl (11) 

B. des Stuhles (2) 

C. dem Stuhl (3) 




D. den Stuhl (4) 



’ Tha number in iMurentheaea indicate* the number of itudents who 
•eleeted the reqxmae. Oceaiionally the total reqxmaee for an item 
do not add up to 22 because one or more students left the item 
unanswered. 
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A. Ihre goto (0) 

B. Ihrer guten (5) 

G. Ihrem guten (5) 

O. Ihren guten (12) 

A. kein (4) 

B. keaie (16) 

C. keinen (1) 

D. keinem (1) 

A. der Laden (lO) 

B. des Ladens (3) 

C. dem Ijaden (7) 

D. den Laden (2) 

A. der Ticrgarten (11) 

B. des Tieigartens (2) 

C. dem Tieigarten (4) 

D. den Tiergarten (5) 

A. der Hut (6) 

B. des Hutes (3) 

C. dem Hut (4) 

D. den Hut (9) 

Here we note that in each case the most popular answer possessed 
an inflecticmal ending identical to the final consonant and/or vowel 
of the word preceding the blank. After the word u6cr, a majority of 
the students chose der (item 11); after habe, the majority selected 
keine (item 9) ; after um, the majority picked dem (item 6). 

If we look at items 1-4 again, we discover that the word pre- 
ceding the blank furnished no clue of this type; consequently the 
answers were randomly selected. 

Conclusion 

It would seem quite apparent that in the particular test which we 
have been describing the students of the lower 27% who answered 
items 5 and 12 correctly did so for the wrong reason; they were 
drawing parelleb between the final vowels or consonants of the 
preceding word and the inflected endings of the options. 

With tlm in mind, the German teacher can proceed to eliminate 



8. Es sind die Blumen Mutter. 



9. Ich habe — Dur-t. 



10. Sie gingen hinter— . 



11. Die Vogel fliegen fiber— . 



12. Er yegt die Hatidschuhe neben 
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from his tests (or simply rework) all items in which such a parallel 
exists. The inflectional system in German lends itself very easily to 
such modification for words of another munber or gender can alway’s 
be found to replace tlie unwanted option. 

As regards to the most common prepositions and their comple- 
ments, the combinations to be avoided may be briefly outlined as 
follows: 

prepositions governing the dntive: 

von — avoid tlie plural 

(aus. bei, mit, nach, seit, zu— no problem) 

prepositions governing the accusative: 

g^en — avoid masculine singular 

ohne — avoid feminine singular and the plural 

bis — avoid neuter singular 

(durch, fur — no problem) 

prepositions governing dative or accusative: 

an, in, neben, zwischen — avoid dative plural and 
accusative masculine singular 
hinter, fiber, unter, vor — avoid dative feminine 

singular 

(auf - no problem 

Similar considerations might also be taken into account in the 
planning of those writing tests in which the student is asked to pro- 
vide the omitted non-content words. The teacher could check to see 
that none of the above combinations occur in the test, for if consonant 
and vowel similaritie' tend to govern the poorer student’s passive 
choice of inflectional endings, perhaps they also tend to govern his 
active use of the same endings. 

By eliminating dubious multiple-choice and fill-in-the-blank items, 
the teacher will be taking a definite step in improving the realiability 
and the validity of his tests. 

Boston College 
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